On Friday, Koko co-founder Rob Morris announced on Twitter that his company ran an experiment to provide AI-written mental health counseling for 4,000 people without informing them first, The Verge reports. Critics have called the experiment deeply unethical because Koko did not obtain informed consent from people seeking counseling. Koko is a nonprofit mental health platform that connects teens and adults who need mental health help to volunteers through messaging apps like Telegram and Discord. On Discord, users sign into the Koko Cares server and send direct messages to a Koko bot that asks several multiple-choice questions (e.g., "What's the darkest thought you have about this?"). It then shares a person's concerns--written as a few sentences of text--anonymously with someone else on the server who can reply anonymously with a short message of their own.

The winning artwork was created using the AI tool Midjourney – which turns lines of text into astonishingly realistic graphics. The award came with a $300 cash prize. AI tools to generate images have been around for years with companies such as Google and OpenAI being notable investors in these text-to-image systems. "I'm not going to apologise for it … I won and I didn't break any rules," Allen, who is from Pueblo, Colorado, told The New York Times newspaper in an interview published on Friday. However, many have taken to social media to express their anger and despair over the award, arguing it took away from the hard work invested by humans to physically create noteworthy art.